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We calculate the stochastic upper bounds for the Lorenz equations using an extension of the 
background method. In analogy with Rayleigh-Benard convection the upper bounds are for heat 
transport versus Rayleigh number. As might be expected, the stochastic upper bounds are larger 
than the deterministic counterpart of Souza and Doering [1], but their variation with noise amplitude 
exhibits interesting behavior. Below the transition to chaotic dynamics the upper bounds increase 
monotonically with noise amplitude. However, in the chaotic regime this monotonicity depends 
on the number of realizations in the ensemble; at a particular Rayleigh number the bound may 
increase or decrease with noise amplitude. The origin of this behavior is the coupling between the 
noise and unstable periodic orbits, the degree of which depends on the degree to which the ensemble 
represents the ergodic set. This is confirmed by examining the close returns plots of the full solutions 
to the stochastic equations and the numerical convergence of the noise correlations. The numerical 
convergence of both the ensemble and time averages of the noise correlations is sufficiently slow that 
it is the limiting aspect of the realization of these bounds. Finally, we note that the full solutions 
of the stochastic equations demonstrate that the effect of noise is equivalent to the effect of chaos. 


I. INTRODUCTION 

Noise is an integral part of any physical system. It 
can be ascribed to fluctuations arising from intermittent 
forcing, observational uncertainties, interference from ex¬ 
ternal sources or unresolved physics. In circumstances 
where noise acts to destroy a signal of interest, it is 
viewed as a nuisance. However, it can also be the case 
that fluctuations act to stabilize a system, examples of 
which include noise-induced optical multi-stability [2], 
asymmetric double well potentials [3], plant ecosystems 
[4], population dynamics [5], and in electron-electron in¬ 
teractions in quantum systems [6]. Curiously, it has re¬ 
cently been shown that noise can have positive effects on 
cognitive functions such as learning and memory [7]. Fi¬ 
nally, a key issue arising when examining observational 
data is whether fluctuations are intrinsic or due to exter¬ 
nal forcing, which can be confounded by temporal mul- 
tifractality [e.g., 8]. 

Given the breadth of settings in which the effects of 
noise manifest themselves on dynamical systems, it ap¬ 
pears prudent to examine such matters in a well stud¬ 
ied and yet broadly relevant system. Thus, we study 
the influence of noise in the Lorenz system [9], which is 
an archetype of deterministic nonlinear dynamics. More¬ 
over, Souza and Doering [1] have recently determined the 
maximal (upper bounds) transport in the Lorenz equa¬ 
tions, thereby providing us with a rigorous test bed for 
stochastic extensions. In §II we describe the stochastic 
Lorenz model, followed by the derivation of the stochas¬ 
tic upper bounds in §111. We interpret the core results 
and their implications in §IV before concluding. 
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II. STOCHASTIC LORENZ MODEL 

The Lorenz model is a Galerkin-modal truncation 
of the equations for Rayleigh-Benard convection with 
stress-free boundary conditions on the upper and lower 
boundaries. It acts as a rich toy model of low-dimensional 
chaos and since it’s origin extensive studies have been 
made spanning a wide range of areas [e.g., 10]. Of par¬ 
ticular relevance here, is using the system as a model for 
heat transport in high Rayleigh number turbulent con¬ 
vection [1]. 

The stochastic form of the Lorenz system is described 
by the following coupled nonlinear ordinary differential 
equations, 

^A = a(y-A) + Aia, 

^Y = Xip-Z)-Y + A2^2, ( 1 ) 

= XY - PZ + Asis 

where X describes the intensity of convective motion, 
Y the temperature difference between ascending and de¬ 
scending flow and Z the deviation from linearity of the 
vertical temperature profile. The control parameters are 
a the Prandtl Number, p the Rayleigh Number and /? a 
domain geometric factor. The A, are the noise ampli¬ 
tudes and are the noise processes. Clearly, the deter¬ 
ministic system has Ai = 0. 

This type of additive noise may appear, for exam¬ 
ple, in observational errors, when the errors do not de¬ 
pend on the system state or as a model of sub-grid scale 
processes approximated by noise associated with unex¬ 
plained physics [11]. In multiplicative noise the system 
has an explicitly state dependent noise process. 
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Although real noise will always have a finite time cor¬ 
relation, taking the limit that the noise correlation goes 
to zero as At 0, serves as a good approximation for 
the noise forcing. This is the white noise limit of colored 
noise forcing. White noise forcing ^{t) is defined by an 
autocorrelation function written as 


Q =-{xy)T + I3 {z)t+ 0{T^i), ( 6 ) 

a 2 a 2 

where, the terms ^ in Eq. 4 and ^ in Eq. 5 are a 
consequence of Ito’s lemma. 

Now, let z = zo + X{t), where zq = is time- 
independent [1], and equations 5 and 6 now become. 


mm)=‘2D6{t-s), (2) 

where, t — s is the time lag, D is the amplitude of the 
noise, (•) represents the time average and S(r) is the 
Dirac delta-function. 


III. STOCHASTIC MAXIMAL TRANSPORT 

Initiated by the work of Louis Howard [12], maximiz¬ 
ing the transport of a quantity such as heat or mass is a 
core organizing principle in modern studies of dissipative 
systems. In this spirit Souza and Doering [1] studied the 
transport in the deterministic Lorenz equations and de¬ 
termined the upper bound, which depends on the exact 
steady solutions X^, Ys, as limr-j-oo {XY)j, = XgYg = 
I3{p - 1), where Xs = Y^ = for p > 1. 

Moreover, they showed that any time-dependent forcing 
would decrease the transport in the system, and hence 
the steady state maximizes the transport in the system. 
We study the effect of noise on the maximal transport in 
this system as the Rayleigh number p is varied. 

Let X = x,Y = py, Z = pz and Ai = A 2 = A 3 = A in 
the system of equations 1 , which transform to 

^x = a{py -x) + A^i, 

^y = x{l-z)-y+-^2, (3) 

at p 

d o 

— z = xy-Pz + -^ 3 . 
at p 

In the next two sub-sections, we calculate the stochas¬ 
tic upper bound of equations 3 using both ltd and 
Stratonovich calculi. 


A. Ito Calculus Framework 

Now, knowing that the state variables {x,y,z) in the 
Lorenz system are bounded [1, 13], and following the ap¬ 
proach of Souza and Doering [1] for this stochastic sys¬ 
tem, the long time averages of ^a;^, -I- z^) and —z 

can be written as 

0 = -{x'^)t + p{xy)T + ^ + —{xii)T + 0(r_i), (4) 
2 a a 


0 = - (y^)T + {xy)T - P{z^)t 

H- {z£,s)t + 0 {T_i), 

P 


— H— {yi^iT 
p p 


( 5 ) 


0 = — + {xy)T — Pzl — 2/3zo(A)t — P{X^)t 

H-yH-( 2 /C 2 )t H- {X^ 3 )t + 0{T_i), and (7) 

P P P 

0 = -(x2/)r + ^zo + /3(A)T + 0(r_i). (8) 

Therefore, equation (7) -|-2zoX (8) becomes, 

0 = - (y^)r + (1 - 2zo)(xy)T + Pz^ - I3 {X‘^)t 

H-yH- {yS,2)T -(A^3)t + 0(7Li). (9) 

P P P 

Now adding (4) to px (9) gives 

0 = - p(2/^)t + /o(l - 2zo)(xy)T + pPzl - pI3{X^)t 

- + {xy)T + —« i)t + — 

P Pf^ P 

+ x-h A(y^ 2 )T + A(A 53 )r- 1 - 0 (r_i), ( 10 ) 

zpa 

and adding {p — l){xy)T to both sides gives, 


(P- 1) {xy)T =Pl3zl +A 


{y^2)T + (A^3)t H- {x^i)t 

ap 


- 


■A 


Vv^ 

2 [1 1 

- -I- 

p 2pa 


Vpy] +P^A^ 


+ 0 (T-^). 


We thus arrive at 

(p - 1 ) {xy)T < pPzo + A^ 
+A 


1 1 
p 2 pa 


1 


( 11 ) 


{y^2)T + {X^3 )t H- {x^i)t 

ap 

+ 0 (T-i). 


( 12 ) 


Comparing equation 12 above with equation 19 from 
Souza and Doering [1], we see an additional term due 
to the stochastic forcing 


lim {XY)j, = lim p {xy)j, 

1 —^00 1 —>^00 


< ^(p- 1 ) -h 


A^ 

p- 1 


-h 


pA 

p- 1 [p 


1 


-{Y£, 2 )t + (A^3)t H- {XS,i)t 

ap 


,(13) 


which shows that the stochastic upper bound transcends 
the deterministic upper bound. 
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B. Stratonovich Calculus Framework 

In this framework, the equations analogous to 4, 5 and 
6 are 

0 = -{x^)t + p{xy)T + —(x^i)t + 0(T_i), (14) 

a 


Due to the fact that the noise is additive, the upper- 
bounds from ltd and Stratonovich calculi should be 
equivalent. This is indeed the case because for the ltd 
result, (X^i) = {y^ 2 } = = 0, whereas for the 

Stratonovich result {X^i) = {¥^ 2 ) = ^ and (A^a) = 
Therefore, when we take the ensemble average of equa¬ 
tions 23 and 13 we obtain 


0 = — + {xy)T — P{z^)t H - {y^2)T 


+ -(^6)T + o(r_i), (15) 

p 


Q =-{xy)T + P{z)t + 0{T_i), (16) 

Again letting z = zq + A(t), where zq = equations 
15 and 16 now become, 

0 = - (y^)T + {xy)T - Pzl - 2(3zo{X)t - P{\^)t 

+ ^(2/^2)r + 4(^^3 )t + 0('r_i), (17) 


0 = -(xr/)T + /3zo + /3(A)T + 0(T_i), (18) 

and hence 17 -|-2zoX 18 becomes, 

0 = - ( 2 /^)t + (1 - 2zo)(xy}T + Pzl - P{X'^)t 

+ j{y^2)T + j{X^3)t + 0{T_i). (19) 

Now adding lx (14) to px (19) we find 
0 = - p{y'^)T + p(l - 2zo){xy)T + pPzl - pP{X'^)t - 
+ {xy)T + 

+ A{yi'i)T + a{x^3)t + o(r_i). 

Finally, adding (p — l){xy)T to both sides gives 


lim {XY)rp) < f3{p— 1) -I- 


T—^-oo 


p-1 


1 


(24) 


We plot equation 24 in Fig. 2, wherein the lines show the 
analytic solution and the solid circles denote the numeri¬ 
cal solution, taking the ensemble average of equation 23, 
all as a function of noise amplitude A. 



( 20 ) 


(p-1) {xy)j, =pl3zl + A 


{y^ 2 )T + (A^3)t H- {xil)T 



P/3A2 


( 21 ) 


FIG. 1. limT->oo {XY)j,, the transport from a single real¬ 
ization of the stochastic Lorenz attractor (equation 1), as a 
function of p and noise amplitude A, with the solid black line 
showing the deterministic upper bound [1]. The inset shows 
the increased transport for p near the transition to chaos; 
Pc = 24.74, beyond which the solutions cross below the deter¬ 
ministic upper bound. 


IV. RESULTS & INTERPRETATION 


We thus arrive at 


(p-1) {xy)j, < pfizl 
+A 


1 


(J/C2)t + {X^3)t H- {x^i)t 

ap 

+ 0 (T-i) 


( 22 ) 


Now, comparing Eq. 22 above with Eq. 19 from Souza 
and Doering [1], we see an additional term due to the 
stochastic forcing, which, as expected from the previous 
section, increases the upper bound; 


lim {XY)rp = lim p (xy) 

T—^oo T—>-oo 

< 1 ) 

, p^ 


p- 1 


-{Y^ 2 )t + (A^3)t H-(A^i)t 

p ap 


(23) 


It is often the case that for the nonlinear dynamical 
systems found in nature, we only have a single time se¬ 
ries. Thus, it is a natural question to ask about the 
properties of the stochastic upper bound both for the en¬ 
semble average and for a small number of realizations. 
Whereas deterministic chaos acts to decrease the trans¬ 
port in the system [1], here we find that it can also be 
indistinguishable from noise. In Fig. 1 we show individ¬ 
ual realizations (one for each of 10 amplitudes A) of the 
transport as a function of p. These exhibit two important 
features. (1) For p below the deterministic transition to 
chaos (pc = 24.74), the solutions transcend the determin¬ 
istic upper bound (DUB), whereas for p above pc they 
cross below it. (2) Independent of p, there is no system¬ 
atic dependence of the solutions on the noise amplitude. 
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FIG. 2. (lirtiT-s-oo {XY)j,) as a function of p and noise ampli¬ 
tude A, with black line showing the upper bound in the deter¬ 
ministic case [1], colored lines showing the analytical solution 
from equation 24 and solid circles showing the numerical so¬ 
lution as the ensemble average in equation 23. 

Taken together these features show that the impact of 
noise differs substantially depending on whether the de¬ 
terministic dynamics is chaotic or non-chaotic. Clearly, 
the role of noise is indistinguishable from the role of 
chaotic dynamics and in individual realizations a given 
noise amplitude couples with various unstable periodic 
orbits, which we discuss in more detail below. 

The analytical solution from equation 24 and the nu¬ 
merical solution (taking the ensemble average in equa¬ 
tion 23) of the stochastic upper bound (SUB) are shown 
in Fig. 2. Firstly, we see the increase in the SUB as the 
noise amplitude A increases. Secondly, for fixed ampli¬ 
tude and values oi p < pc, the origin of the increase in 
the SUB are the two terms proportional to 1/p. As p in¬ 
creases and A decreases the SUB converges to the DUB 
from above. The increase with A at low p is a reflection 
of the dependence of the “diameter” of the system in the 
X — Y plane, other parameters being held constant. Be¬ 
cause the diameter decreases as p decreases, the relative 
influence of A on the SUB is larger. We show this for 
p = 2 in Fig. 3. Flowever, we note that, using a differ¬ 
ent method Fantuzzi and Goluskin (pers. comm.) find a 
SUB that does not exhibit the low p divergence, asymp¬ 
totes to our bound for p in the region of typical interest, 
and also recovers the DUB in the appropriate limit. 

A more detailed view of the SUB from Eq. 23 is shown 
in Fig 4. The lower right inset shows that for p < Pc the 
SUB is a monotonic function of the noise amplitude, as 
one would intuitively expect from Fig. 3. However, as 
the system enters the chaotic regime, this monotonicity 
is lost to reveal an oscillation with amplitude, as shown 
in the upper inset of Fig. 4 for noise amplitudes A = 9 
and A = 10. This oscillatory behavior is due to the cou¬ 
pling of noise with chaotic orbits that, depending on the 
amplitude, can result in different residence times of a tra¬ 
jectory in different orbits. Indeed, although for p < pc. 



FIG. 3. XY-space of the stochastic Lorenz attractor (equation 
1), for three different noise amplitudes. The diameter of the 
attractor increases with noise amplitude. 

the realization to realization stochastic upper bounds are 
consistent, this is not the case in the chaotic regime due 
to the coupling between the noise and the chaotic orbits. 
In consequence, each realization results in a slightly dif¬ 
ferent SUB and hence the bound is not strict; it has a 
diffuseness that depends on the noise amplitude. This 
combined effect of noise and the exponential divergence 
property of chaos allows the noise to perturb the stochas¬ 
tic system into a different orbit in each realization. 



FIG. 4. The stochastic upper-bound (circles) from Eq. 23 as 
a function of p and noise amplitude A. The solid black line 
is the DUB [1]. The bottom inset shows that the SUB is a 
monontoic function of A in the non-chaotic regime (p < pc). 
The top inset shows the oscillations of the SUB between noise 
amplitudes A = 9,10 in the chaotic regime (p < pc). 

The close returns plot of Mindlin and Gilmore [14] can 
be used to extract unstable periodic orbits (UPO) from 
a chaotic time series. Thus, to demonstrate the coupling 
between noise and chaos discussed above in a different 
manner, we show the close returns plot for the stochastic 
Lorenz attractor (equation 1) for A = 9,10 and p = 97 
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in Fig. 5 (a, c). These plots help us distinguish between 
noise and chaos. Whereas in a noisy system the points 
are more diffuse, in a chaotic system they are more struc¬ 
tured, with continuous straight lines defining the UPOs. 



2-Norm (i, a) 2-Norm (i, n) 


FIG. 5. Scaled close returns plots (a,c) and the corresponding 
histograms of the 2—norm of these (b,d) for the stochastic 
Lorenz attractor (equation 1) with p — 97, where the hori¬ 
zontal segments represent the UPOs in the system when they 
close up when embedded in the phase space of the attractor. 
The scaled index in the time series is i, and a is the scaled 
period of the UPO. (a, b) A = 9. (c, d) A — 10. 

To further quantify this structure, in Fig. 5 (b,d) we 
plot the histogram of the 2—norm of the points from the 
close returns plot. The peaks in the histogram show the 
UPOs in the system, corresponding to the lines in the 
close returns plot. Whereas the histogram in Fig. 5(6) 
has a broad-band structure, that in Fig. 5(d) reveals 
prominent peaks at different norms. 

V. SUMMARY 

We calculated the stochastic upper bounds of the heat 
for the Lorenz equations using an extension of the back¬ 


ground method of Souza and Doering [1] used in the de¬ 
terministic system. Whilst one might have expected that 
the stochastic upper bounds transcend their determinis¬ 
tic counterpart of [1] , their variation with noise amplitude 
exhibits rich behavior. In the non-chaotic regime the 
upper bounds increase monotonically with noise ampli¬ 
tude. However, in the chaotic regime this monotonicity 
depends on the number of realizations in the ensemble; 
at a particular Rayleigh number the bound may increase 
or decrease with noise amplitude. The origin of this be¬ 
havior is the coupling between the noise and unstable pe¬ 
riodic orbits, the degree of which depends on the degree 
to which the ensemble represents the ergodic set. This 
is confirmed by examining the close returns plots of the 
full solutions to the stochastic equations. These solutions 
also demonstrate that the effect of noise is equivalent to 
the effect of chaos for a wide range of noise amplitude. 
Finally, we note that although in Jtd-calculus the ana¬ 
lytic bound (equation 24) relies on vanishing noise cor¬ 
relations ((^^i) = (U^ 2 ) = = 0), numerically such 

correlations never completely vanish [e.g., 15] [16], for as 
the size and diffuseness of stochastic attractor continually 
increases, the extent to which ensemble average reaches 
the ergodic set remains a concept rather than a practical 
reality. 
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